A Randomized Controlled Study on Clinical Adherence to Evidence-Based Guidelines in the Management of Simulated Patients With Barrett's Esophagus and the Clinical Utility of a Tissue Systems Pathology Test: Results From Q-TAB.

INTRODUCTION: Barrett's esophagus (BE) is a precursor to esophageal adenocarcinoma. Physicians infrequently adhere to guidelines for managing BE, leading to either reduced detection of dysplasia or inappropriate re-evaluation. METHODS: We conducted a three-arm randomized controlled trial with 2 intervention arms to determine the impact of a tissue systems pathology (TSP-9) test on the adherence to evidence-based guidelines for simulated patients with BE. Intervention 1 received TSP-9 results, and intervention 2 had the option to order TSP-9 results. We collected data from 259 practicing gastroenterologists and gastrointestinal surgeons who evaluated and made management decisions for 3 types of simulated patients with BE: nondysplastic BE, indefinite for dysplasia, and low-grade dysplasia. RESULTS: Intervention 1 was significantly more likely to correctly assess risk of progression to high-grade dysplasia/esophageal adenocarcinoma and offer treatment in accordance with US society guidelines compared with the control group (+6.9%, 95% confidence interval +1.4% to +12.3%). There was no significant difference in ordering guideline-recommended endoscopic eradication therapy. However, for cases requiring annual endoscopic surveillance, we found significant improvement in adherence for intervention 1, with a difference-in-difference of +18.5% ( P = 0.019). Intervention 2 ordered the TSP-9 test in 21.9% of their cases. Those who ordered the test performed similarly to intervention 1; those who did not, performed similarly to the control group. DISCUSSION: The TSP-9 test optimized adherence to clinical guidelines for surveillance and treatment of both patients with BE at high and low risk of disease progression. Use of the TSP-9 test can enable physicians to make risk-aligned management decisions, leading to improved patient health outcomes.

Clinical utility of a novel test for assessing cardiovascular disease risk in type 2 diabetes: a randomized controlled trial.

BACKGROUND: The risk for and treatment of cardiovascular disease (CVD) in type 2 diabetes (T2DM) is often incorrect and delayed. We wished to determine if a novel test improved physicians' ability to risk stratify, diagnose, and treat patients with T2DM. METHODS: In a 2-phase randomized controlled trial comparing the clinical workup, diagnosis, and management of online, simulated patients with T2DM in a nationwide sample of cardiologists and primary care physicians, participants were randomly assigned to control or one of two intervention groups. Intervention participants had access to standard of care diagnostic tools plus a novel diagnostic CVD risk stratification test. RESULTS: In control, there was no change in CV risk stratification of simulated patients between baseline and round 2 (37.1 to 38.3%, p = 0.778). Pre-post analysis showed significant improvements in risk stratification in both Intervention 1 (38.7 to 65.3%) and Intervention 2 (41.9 to 65.8%) (p < 0.01) compared to controls. Both intervention groups significantly increased prescribing SGLT2 inhibitors/GLP1 receptor agonists versus control, + 18.9% for Intervention 1 (p = 0.020) and 1 + 9.4% for Intervention 2 (p = 0.014). Non-pharmacologic treatment improved significantly compared to control (+ 30.0% in Intervention 1 (p < 0.001) and + 22.8% in Intervention 2 (p = 0.001). Finally, monitoring HgbA1C, blood pressure, and follow-up visit frequency improved by + 20.3% (p = 0.004) in Intervention 1 and + 29.8% (p < 0.001) in Intervention 2 compared with control. CONCLUSION: Use of the novel test significantly improved CV risk stratification among T2DM patients. Statistically significant increases treatments were demonstrated, specifically SGLT2 inhibitors and GLP1 receptor antagonists and recommendations of evidence-based non-pharmacologic treatments. Trial registration ClinicalTrials.gov, NCT05237271.

Clinical Variation in the Treatment Practices for Patients With Type 2 Diabetes: A Cross-Sectional Patient Simulation Study Among Primary Care Physicians and Cardiologists.

Background Cardiovascular disease risk stratification is necessary and critically important in patients with type 2 diabetes. Despite its known benefits to guide treatment and prevention, we hypothesized that providers do not routinely incorporate this into their diagnostic and treatment decisions. Methods and Results The QuiCER DM (QURE CVD Evaluation of Risk in Diabetes Mellitus) study enrolled 161 primary care physicians and 80 cardiologists. Between March 2022 and June 2022, we measured the care variation in risk determination among these providers caring for simulated patients with type 2 diabetes. We found a wide variation in the overall assessment of cardiovascular disease in patients with type 2 diabetes. Participants performed half of the necessary care items with quality-of-care scores, ranging between 13% and 84%, averaging 49.4±12.6%. Participants did not assess cardiovascular risk in 18.3% of cases and incorrectly stratified risk in 42.8% of cases. Only 38.9% of participants arrived at the correct cardiovascular risk stratification. Those who correctly identified a cardiovascular risk score were significantly more likely to order nonpharmacologic treatments, advising on their patients' nutrition (38.8% versus 29.9%, P=0.013) and the correct glycated hemoglobin target (37.7% versus 15.6%, P<0.001). Pharmacologic treatments, however, did not vary between those who correctly specified risk and those who did not. Conclusions Physician participants struggled to determine the correct cardiovascular disease risk and specify the appropriate pharmacologic interventions in simulated patients with type 2 diabetes. Additionally, there was a wide variation in the quality of care regardless of risk level, indicating opportunities to improve risk stratification.

Randomized prospective trial to detect and distinguish between medication nonadherence, drug-drug interactions, and disease progression in chronic cardiometabolic disease.

BACKGROUND: Disentangling nonadherence (NA), drug-drug interactions (DDIs), and disease progression from each other is an important clinical challenge for providers caring for patients with cardiometabolic diseases. NAs and DDIs are both ubiquitous and often overlooked. We studied a novel chronic disease management (CDM) test to detect medication adherence and the presence and severity of DDIs. MATERIALS AND METHODS: We conducted a prospective, randomized controlled trial of 236 primary care physicians using computer-based, simulated patients, measuring clinical care with and without access to the CDM test. The primary outcomes were whether use of the CDM test increased the accuracy of diagnoses and ordering better treatments and how effective the intervention materials were in getting participants to order the CDM test. RESULTS: Physicians given the CDM test results showed a + 13.2% improvement in their diagnosis and treatment quality-of-care scores (p < 0.001) in the NA patient cases and a + 13.6% improvement in the DDI cases (p < 0.001). The difference-in-difference calculations between the intervention and control groups were + 10.4% for NA and + 10.8% for DDI (p < 0.01 for both). After controlling for physician and practice co-factors, intervention, compared to control, was 50.4x more likely to recognize medication NA and 3.3x more likely to correctly treat it. Intervention was 26.9x more likely to identify the DDI and 15.7x more likely to stop/switch the interacting medication compared to control. We found no significant improvements for the disease progression patient cases. CONCLUSION: Distinguishing between nonadherence, drug-drug interactions, and disease progression is greatly improved using a reliable test, like the CDM test; improved diagnostic accuracy and treatment has the potential to improve patient quality of life, medication safety, clinical outcomes, and efficiency of health delivery. TRIAL REGISTRATION: clinicaltrials.gov (NCT05192590).

Gaps in the Care of Pulmonary Hypertension: A Cross-Sectional Patient Simulation Study Among Practicing Cardiologists and Pulmonologists.

Background Diagnosis of pulmonary hypertension (PH) is often delayed or missed, leading to disease progression and missed treatment opportunities. In this study, we measured variation in care provided by board-certified cardiologists and pulmonologists in simulated patients with potentially undiagnosed PH. Methods and Results In a cross-sectional study (https://www.clinicaltrials.gov, NCT04693793), 219 US practicing cardiologists and pulmonologists cared for simulated patients presenting with symptoms of chronic dyspnea and associated signs of potential PH. We scored the clinical quality-of-care decisions made in a clinical encounter against predetermined evidence-based criteria. Overall, quality-of-care scores ranged from 18% to 74%, averaging 43.2%±11.5%. PH, when present, was correctly suspected 49.1% of the time. Conversely, physicians incorrectly identified PH in 53.7% of non-PH cases. Physicians ordered 2-dimensional echocardiography in just 64.3% of cases overall. Physicians who ordered 2-dimensional echocardiography in the PH cases were significantly more likely to get the presumptive diagnosis (61.9% versus 30.7%; P<0.001). Ordering other diagnostic work-up items showed similar results for ventilation/perfusion scan (81.5% versus 51.4%; P=0.005) and high-resolution computed tomography (60.4% versus 43.2%; P=0.001). Physicians who correctly identified PH were significantly more likely to order confirmatory right heart catheterization or refer to PH center (67.3% versus 15.8%; P<0.001). Conclusions A wide range of care in the clinical practice among simulated patients presenting with possible PH was found, specifically in the evaluation and plan for definitive diagnosis of patients with PH. The delay or misdiagnosis of PH is likely attributed to a low clinical suspicion, nonspecific symptoms, and underuse of key diagnostic tests. Registration URL: https://www.clinicaltrials.gov; Unique identifier: NCT04693793.

Clinical Variation in the Treatment Practices for Medication Nonadherence, Drug-Drug Interactions, and Recognition of Disease Progression in Patients with Chronic Cardiometabolic Diseases: A Cross-Sectional Patient Simulation Study among Primary Care Physicians.

Background: Medication nonadherence in patients with chronic diseases is common, costly, and often underdiagnosed. In the United States, approximately 40-50% of patients with cardiometabolic conditions are not adherent to long-term medications. Drug-drug interactions (DDI) are also underrecognized and may lead to medication nonadherence in this patient population. Treatment complexity associated with cardiometabolic conditions contributes to increased risk for adverse drug events and DDIs. Methods: We recruited a nationally representative sample of 246 board-certified family and internal medicine physicians to evaluate how they assessed, identified, and treated medication nonadherence, DDIs, and worsening disease. Participating physicians were asked to care for three online simulated patients, each with at least one chronic cardiometabolic disease, including atrial fibrillation, heart failure, diabetes mellitus, or hypertension, and who were taking prescription medications for their disease. Physicians' scores were based on evidence-based care recommendation criteria, including overall care quality and treatment for medication nonadherence and DDIs. Results: Overall, quality-of-care scores across all cases ranged from 13% to 87% with an average of 50.8% ± 12.1%. The average overall diagnostic plus treatment score was 21.9% ± 13.6%. Participants identified nonadherence in just 3.6% of cases, DDIs in 8.9% of cases, and disease progression in 30.3% of cases. Conclusions: Based on these study results, primary care physicians were unable to adequately diagnose and treat patients with chronic cardiometabolic diseases who either suffered from medication nonadherence, DDIs, or progression of the disease. Improved standardization and technique in identifying these diagnoses is needed in primary care. Trial Registration. This trial is registered with clinicaltrials.gov, NCT05192590.

Clinical variation in surveillance and management of Barrett's esophagus: A cross-sectional study of gastroenterologists and gastrointestinal surgeons.

Appropriate surveillance and treatment of Barrett's esophagus (BE) is vital to prevent disease progression and decrease esophageal adenocarcinoma (EAC)-related mortality. We sought to determine the variation in BE care and identify improvement opportunities. 275 physicians (113 general gastroenterologists, 128 interventional gastroenterologists, 34 gastrointestinal surgeons) cared for 3 simulated patients, one each from 3 BE clinical scenarios: non-dysplastic BE (NDBE), BE indefinite for dysplasia (IND), and BE with low grade dysplasia (LGD), and care scores were measured against societal guidelines. Overall quality-of-care scores ranged from 17% to 85% with mean of 47.9% ± 11.8% for NDBE, 50.8% ± 11.7% for IND, and 52.7% ± 12.2% for LGD. Participants appropriately determined risk of progression 20.3% of the time: 14.4% for NDBE cases, 19.9% for LGD cases, and 26.8% for IND cases (P = .001). Treatment and follow-up care scores averaged 12.9% ± 17.5% overall. For the LGD cases, guideline-recommended twice-daily PPI treatment was ordered only 24.7% of the time. Guideline-based follow-up endoscopic surveillance was done in only 27.7% of NDBE cases and 32.7% of IND cases. For the LGD cases, 45.4% ordered endoscopic eradication therapy while 25.1% chose annual endoscopic surveillance. Finally, participants provided counseling on lifestyle modifications in just 20% of cases. Overall care of patients diagnosed with BE varied widely and showed room for improvement. Specific opportunities for improvement were adherence to guideline recommended surveillance intervals, patient counseling, and treatment selection for LGD. Physicians would potentially benefit from additional BE education, endoscopic advances, and better methods for risk stratification.

Budget Impact of Adaptive Abiraterone Therapy for Castration-Resistant Prostate Cancer.

BACKGROUND: The use of a novel strategy known as adaptive abiraterone therapy based on mathematical modeling of evolutionary dynamics of tumor subpopulations was shown in a clinical trial to extend the time to disease progression in patients with metastatic castration-resistant prostate cancer (CRPC) and reduced the use of abiraterone therapy. Although the clinical impact of adaptive abiraterone treatment is clear, the economic impact of this strategy has not been investigated. OBJECTIVE: To compare the cost of care with adaptive abiraterone therapy versus standard continuous abiraterone therapy in patients with metastatic CRPC, using patient billing data. METHODS: We performed a retrospective review of billing data for patients with metastatic CRPC who received abiraterone treatment at a large cancer center between June 1, 2012, and August 31, 2018. Patients were divided into 2 groups based on whether they received adaptive abiraterone therapy (N = 15) or continuous abiraterone therapy (N = 21). All patients with refractory, metastatic prostate cancer after castration that was indicated for abiraterone therapy were eligible for this study. Each patient in the adaptive abiraterone therapy cohort received abiraterone plus prednisone treatment until the patient reached a target threshold of 50% or more reduction in prostate-specific antigen (PSA) level compared with his PSA level before abiraterone therapy; treatment was then suspended until the PSA level rose above the 50% of PSA before abiraterone therapy target threshold. The continuous therapy cohort received abiraterone plus prednisone daily until radiographic progression. The primary outcomes were the mean annual cost of care per patient, including and excluding the cost of abiraterone, and the cost of care, by clinical category. RESULTS: The median time to disease progression was 25.8 months for patients who received adaptive abiraterone therapy compared with 12.1 months for patients who received continuous abiraterone therapy. Overall, the mean total, including the cost of drug, annual cost per patient who received adaptive abiraterone therapy was $79,093 compared with $146,782 for patients who received continuous abiraterone therapy (P <.0001). The annual cost of care per patient, excluding the cost of abiraterone, was $13,883 for those who received adaptive therapy versus $22,322 for those who received continuous abiraterone therapy (P = .2757), which was not statistically significant. CONCLUSION: Practical precision medicine strategies, such as adaptive abiraterone treatment or pharmacogenomics-targeted dosing, can use known biomarkers, such as PSA, to tailor therapy, generate improved outcomes, and reduce costs without the need for novel drug and diagnostic discovery and development. The results of this study suggest that a large clinical study of adaptive abiraterone therapy is warranted to validate the potential of this strategy to extend the time to disease progression and reduce costs of treatment of metastatic CRPC.

A nationwide program to improve clinical care quality in the Kyrgyz Republic.

BACKGROUND: To assess baseline quality of care in the Kyrgyz Republic in 2019 and determine the effect of online simulated patients in changing doctors' practice in three specific disease areas: non-communicable disease, neonatal/child health, and maternal health. METHODS: Over 2000 family health, pediatric, neonatology, therapy, and obstetric-gynecologic doctors from every rayon (district) hospital and at least one associated family health (Primary) care clinic participated. To adequately scale the project, the Ministry of Health used online simulated Clinical Performance and Value (CPV) vignettes. All doctors cared for the same set of patients in their clinical area. Over eight months in 2019, we gathered three rounds of CPV data in seven oblasts. RESULTS: Overall quality scores were highly variable at baseline (59.2% + 13.5%). After three rounds the average score increased 6.5% (P < 0.001). By the end of round three, the lowest scoring oblast was providing higher quality care compared to the highest scoring oblast in the initial round (64.2% in round 3 vs 62.4% in round 1), indicating greater adherence to the evidence base. Additionally, family health doctors ordered 26% fewer unnecessary tests (P < 0.05), while specialists ordered 39% fewer unnecessary tests (P < 0.05). If trends continue, this translates into a net annual savings of 63 million Kyrgyz som. CONCLUSIONS: This study demonstrates serial measurement of care provided by over 2000 physicians in the Kyrgyz Republic can be improved as measured by CPVs. This project may be a useful template to improve health care quality at a national level in other low- and middle-income country settings.

Variation in Diabetes Management: A National Assessment of Primary Care Providers.

BACKGROUND: Glucose control is monitored primarily through ordering HbA1c levels, which is problematic in patients with glycemic variability. Herein, we report on the management of these patients by board-certified primary care providers (PCPs) in the United States. METHODS: We measured provider practice in a representative sample of 156 PCPs. All providers cared for simulated patients with diabetes presenting with symptoms of glycemic variability. Provider responses were reviewed by trained clinicians against evidence-based care standards and accepted standard of care protocols. RESULTS: Care varied widely-overall quality of care averaged 51.3%±10.6%-with providers performing just over half the evidence-based practices necessary for their cases. More worryingly, provider identified the underlying etiology of the poor glycemic control only 36.3% of the time. HbA1c was routinely ordered in 91.3% of all cases but often (59.5%) inappropriately. Ordering other tests of glycemic control (done in 15% of cases) led to significant increases in identifying the etiology of the hyperglycemia. Correctly modifying their patient's treatment was more likely to occur if doctors first identified the underlying etiology (65.9% vs 49.0%, P<0.001). We conservatively estimated a US $65/patient/visit in unnecessary testing and US $389 annually in additional care costs when the etiology was missed, translating potentially into millions of dollars of wasteful spending. CONCLUSION: Despite established evidence that HbA1c misses short-term changes in diabetes, we found PCPs consistently ordered HbA1c, rarely using other available blood tests. However, if the factors leading to poor glycemic control were recognized, PCPs were more likely to correctly alter their patient's hypoglycemic therapy.

Reducing Unwarranted Oncology Care Variation Across a Clinically Integrated Network: A Collaborative Physician Engagement Strategy.

PURPOSE: Addressing unwarranted clinical variation in oncology is a high priority for health systems that aspire to ensure consistent levels of high-quality and cost-effective care. Efforts to improve clinical practice and standardize care have proven challenging. Advocate Physician Partners undertook a patient simulation-based practice measurement and feedback project that was focused on breast and lung cancer to engage oncologists in the care standardization process. METHODS: One hundred three medical oncologists cared for online simulated patients using the Clinical Performance and Value platform, receiving feedback on how their care decisions compared with evidence-based guidelines and their peers. We repeated this process every 4 months over six rounds, measuring changes in quality-of-care scores. We then compared simulated patient results with available patient-level claims data. RESULTS: Over the course of the project, overall quality-of-care scores improved 11.9% (P < .001). Diagnostic accuracy increased 6.7% (P < .001) and correlated with improved treatment scores, including a nearly 10-percentage point increase in evidence-based chemotherapy regimens (P = .009) and a 56% increase in addressing palliative needs for patients with late-stage disease (P < .001). Unnecessary test ordering declined 25% (P < .001). We compared these results with available patient data and observed concordance with the metastatic imaging workup order rate for early-stage breast cancer. As unnecessary workups declined in the simulations and became more closely aligned with evidence-based guidelines, we saw similar rates of decline in the patient-level data. CONCLUSION: This study demonstrates that an oncology care standardization system that combines simulated patients with serial feedback increases evidence-based and cost-effective clinical decisions in patient simulations and patient-level data.

Reducing Unneeded Clinical Variation in Sepsis and Heart Failure Care to Improve Outcomes and Reduce Cost: A Collaborative Engagement with Hospitalists in a MultiState System.

OBJECTIVE: To (1) measure hospitalist care for sepsis and heart failure patients using online simulated patients, (2) improve quality and reduce cost through customized feedback, and (3) compare patient-level outcomes between project participants and nonparticipants. METHODS: We conducted a prospective, quasi-controlled cohort study of hospitalists in eight hospitals matched with comparator hospitalists in six nonparticipating hospitals across the AdventHealth system. We provided measurement and feedback to participants using Clinical Performance and Value (CPV) vignettes to measure and track quality improvement. We then compared length of stay (LOS) and cost results between the two groups. RESULTS: 107 providers participated in the study. Over two years, participants improved CPV scores by nearly 8% (P < .001), with improvements in utilization of the three-hour sepsis bundle (46.0% vs 57.7%; P = .034) and ordering essential medical treatment elements for heart failure (58.2% vs 72.1%; P = .038). In study year one, average LOS observed/expected (O/E) rates dropped by 8% for participants, compared to 2.5% in the comparator group, equating to an additional 570 hospital days saved among project participants. In study year two, cost O/E rates improved from 1.16 to 0.98 for participants versus 1.14 to 1.01 in the comparator group. Based on these improvements, we calculated total cost savings of $6.2 million among study participants, with $3.8 million linked to system-wide improvements and an additional $2.4 million in savings attributable to this project. CONCLUSIONS: CPV case simulation-based measurement and feedback helped drive improvements in evidence-based care that translated into lower costs and LOS, above-and-beyond other improvements at AdventHealth.

A Better Pathway? Building Consensus and Engaging Providers with Feedback to Improve and Standardize Cancer Care.

INTRODUCTION: Unwanted clinical variation is common across the United States health care system and is particularly vexing in oncology owing to the complexity, morbidity, and high cost of the disease. Efforts to standardize care including guidelines and continuing medical education have had only limited impact. Disease-specific oncology clinical pathways hold the promise of reducing variation but have been hampered by a lack of ownership and accountability among oncology providers. MATERIALS AND METHODS: We describe the utility of combining a patient simulation-based clinical variation measurement with the in-house development of multidisciplinary breast cancer pathways at a National Cancer Institute-designated cancer center. RESULTS: At baseline, we found high variation in care decisions across the multidisciplinary team and within individual specialties in the management of simulated patients. Development and introduction of breast cancer clinical pathways combined with individual and group feedback on pathway adherence led to significant increases in pathway-aligned care decisions and decreases in measured variation. Overall quality scores increased from 47.5% to 61.1% (P < .001), with the largest improvement in diagnostic accuracy (+22.1%). Providers also ordered fewer unnecessary tests, saving an estimated $305 per patient case. Adherence to preferred chemotherapy regimens increased for both medical oncologists (+16%) and other members of the multidisciplinary team (+19%). CONCLUSION: Our work shows that a structured process to measure clinical variation and provide personalized feedback to an oncology multidisciplinary team drives adoption of evidence-based pathways, less unneeded spending, and higher quality care for patients.

Engaging Primary Care Providers to Reduce Unwanted Clinical Variation and Support ACO Cost and Quality Goals: A Unique Provider-Payer Collaboration.

This project was undertaken to reduce unneeded variation among practicing primary care clinicians participating in an accountable care organization (ACO) and to raise quality and reduce costs. This real-world, quasi-controlled experiment compared ACO target improvements between 3 participating geographic regions and members within the ProHealth ACO against nonparticipating regions and members. The authors used a novel care standardization initiative to engage participating providers. This was a 2-year longitudinal study with 6 rounds of serially measured provider care decisions and customized individual and group improvement feedback. Participating providers cared for online patient simulations as they would actual patients, and their care decisions were scored against evidence-based guidelines. This approach generated significant increases in evidence-based quality scores (+27%) and reductions in unneeded testing (-55%) in the patient simulations. Improvements in the online simulated patients correlated with improvements in patient-level ACO quality measures, which showed gains above and beyond the quasi-control group. Reductions calculated for spending on unneeded tests and specialist referrals exceeded $4.8 million. This study found that supporting practicing physicians in ACOs with evidence-based feedback significantly improved care and cost-efficiency.

Large-Scale Evaluation of Quality of Care in 6 Countries of Eastern Europe and Central Asia Using Clinical Performance and Value Vignettes.

BACKGROUND: A significant determinant of population health outcomes is the quality of care provided for noncommunicable diseases, obstetric, and pediatric care. We present results on clinical practice quality in these areas as measured among nearly 4,000 providers working at more than 1,000 facilities in 6 Eastern European and Central Asian countries. METHODS: This study was conducted between March 2011 and April 2013 in Albania, Armenia, Georgia, Kazakhstan, Kirov Province in Russia, and Tajikistan. Using a probability proportional-to-size sampling technique, based on number of hospital beds, we randomly selected within each country 42 hospitals and their associated primary health care clinics. Physicians and midwives within each clinical area of interest were randomly selected from each hospital and clinic and asked how they would care for simulated patients using Clinical Performance and Value (CPV) vignettes. Facility administrators were also asked to complete a facility survey to collect structural measures of quality. CPV vignettes were scored on a scale of 0% to 100% for each provider. We used descriptive statistics and t tests to identify significant differences in CPV scores between hospitals and clinics and rural vs. urban facilities, and ANOVA to identify significant differences in CPV scores across countries. RESULTS: We found that quality of care, as concurrently measured by performance on CPV vignettes, was generally poor and widely variable within and between countries. Providers in Kirov Province, Russia, had the highest overall performance, with an average score of 70.8%, while providers in Albania and Tajikistan had the lowest average score, each at 50.8%. The CPV vignettes with the lowest scores were for multiple noncommunicable disease risk factors and birth asphyxia. A considerable proportion (11%) of providers performed well on the CPV vignettes, regardless of country, facility, or structural resources available to them. CONCLUSIONS: Countries of Eastern Europe and Central Asia are challenged by poor performance as measured by clinical care vignettes, but there is potential for provision of high-quality care by a sizable proportion of providers. Large-scale assessments of quality of care have been hampered by the lack of effective measurement tools that provide generalizable and reliable results across diverse economic, cultural, and social settings. The feasibility of quality measurement using CPV vignettes in these 6 countries and the ability to combine results with individual feedback could significantly enhance strategies to improve quality of care, and ultimately population health.

Impact of a protein-based assay that predicts prostate cancer aggressiveness on urologists' recommendations for active treatment or active surveillance: a randomized clinical utility trial.

BACKGROUND: Of the more than 1.1 million men diagnosed worldwide annually with prostate cancer, the majority have indolent tumors. Distinguishing between aggressive and indolent cancer is an important clinical challenge. The current approaches for assessing tumor aggressiveness are recognized as insufficient. A validated protein-based assay has been shown to predict tumor aggressiveness from prostate biopsy. The main objective of this study was to measure the clinical utility of this new assay in the management of early-stage prostate cancer. METHODS: One hundred twenty nine board-certified urologists were asked to participate in a randomized, two-arm experiment. We collected data over 2 rounds using simulated clinical cases administered via an online platform. The cases were all newly diagnosed Gleason 3 + 3 or 3 + 4 prostate camcer patients. Urologists in the intervention arm received a 15-min webinar on this protein-based assay and given assay test results for their simulated patients in round 2. Each case had a preferred recommendation of either active surveillance or active treatment. The measured outcome was rate of preferred recommendation, defined as urologists who recommended the proper treatment course. Analyses were done using difference-in-difference estimations. RESULTS: Using multinomial logistical regression, urologists who were given the assay results were significantly more likely to choose the preferred recommendation (active surveillance or active treatment) compared to controls (p = 0.004). These urologists were also significantly more likely to involve their patients in the treatment decision compared to controls (p = 0.001). CONCLUSIONS: By providing additional information to inform the physician's treatment plan, a protein-based assay shows demonstrable clinical utility confirmed through a rigorous randomized controlled study design and regression analyses to test for effects.

Comparative effectiveness of two disparate policies on child health: experimental evidence from the Philippines.

BACKGROUND: Should health systems invest more in access to care by expanding insurance coverage or in health care services including improving the quality of care? Comparing these options experimentally would shed light on the impact and cost-effectiveness of these strategies. METHODS: The Quality Improvement Demonstration Study (QIDS) was a randomized policy experiment conducted across 30 districts in the Philippines. The study had a control group and two policy intervention groups intended to improve the health of young children. The demand-side intervention in QIDS was universal health insurance coverage (UHC) for children aged 5 years or younger, and a supply-side intervention, a pay-for-performance (P4P) bonus for all providers who met pre-determined quality levels. In this paper, we compare the impacts of these policies from the QIDS experiment on childhood wasting by calculating DALYs averted per US$spent. RESULTS: The direct per capita costs to implement UHC and P4P are US$4.08 and US$1.98 higher, respectively, compared to control. DALYs due to wasting were reduced by 334,862 in UHC and 1,073,185 in P4P. When adjustments are made for the efficiency of higher quality, the DALYS averted per US$ spent is similar in the two arms, 1.56 and 1.58 for UHC and P4P, respectively. Since the P4P quality improvements touches all patients seen by qualifying providers (32% in UHC versus 100% in P4P), there is a larger reduction in DALYs. With similar programmatic costs for either intervention, in this study, each US$spent under P4P yielded 1.52 DALYs averted compared to the standard program, while UHC yielded only a 0.50 DALY reduction. CONCLUSION: P4P had a greater impact and was more cost-effective compared to UHC as measured by DALYs averted. While expanded insurance benefit ceilings affected only those who are covered, P4P incentivizes practice quality improvement regardless of whether children are insured or uninsured.

Using Text Reminder to Improve Childhood Immunization Adherence in the Philippines.

A comparative descriptive study was conducted to determine the effectiveness of text messages with pictures compared with plain text messages or verbal reminders in improving measles, mumps, and rubella immunization compliance in the rural areas of the Philippines. We found that text messaging with or without pictures is a feasible and useful tool in measles, mumps, rubella immunization compliance for childhood immunization. Texting with pictures (n = 23), however, was no more effective than plain text messaging (n = 19) or verbal reminder (n = 17) in improving measles, mumps, and rubella immunization compliance. Compared with parents who received verbal reminders alone, either type of text reminders was linked to parents bringing their child for measles, mumps, and rubella immunization on a timelier basis, as defined by the difference between the scheduled visit and the actual visit, although this was not statistically significant. Mobile technology that uses text reminders for immunization can potentially improve the communication process between parent, the public health nurse, and healthcare provider. Future studies can explore the application of plain text messages or text messages with pictures to improve compliance more broadly for maternal and child healthcare especially in rural areas of developing countries and may be a helpful tool for health promotion for this population.